Outline of machine learning
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
top
The following outline is provided as an overview of, and topical guide to, machine learning:
Machine learning (ML) is a subfield of artificial intelligence within computer science that evolved from the study of pattern recognition and computational learning theory.cite-ref-britannica-1-0[1] In 1959, Arthur Samuel defined machine learning as a "field of study that gives computers the ability to learn without being explicitly programmed".cite-ref-arthur-samuel-machine-learning-def-2-0[2] ML involves the study and construction of algorithms that can learn from and make predictions on data.cite-ref-3[3] These algorithms operate by building a model from a training set of example observations to make data-driven predictions or decisions expressed as outputs, rather than following strictly static program instructions.
Contents
β’ Meta-learning
β’ Deep learning
β’ See also
β’ Other
β’ Further reading
β’ References
β’ External links
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
How can machine learning be categorized?
β’ An academic discipline
β’ A branch of science
β’ An applied science
β’ A subfield of computer science
β’ A branch of artificial intelligence
β’ A subfield of soft computing
β’ Application of statistics
Paradigms of machine learning
β’ Supervised learning, where the model is trained on labeled data
β’ Unsupervised learning, where the model tries to identify patterns in unlabeled data
β’ Reinforcement learning, where the model learns to make decisions by receiving rewards or penalties.
Applications of machine learning
β’ Bioinformatics
β’ Computer vision
β’ Data mining
β’ Earth sciences
β’ Email filtering
β’ Inverted pendulum (balance and equilibrium system)
β’ Dialog system
β’ Grammar checker
β’ Language recognition
β’ Speech synthesis
β’ Text mining
β’ Search engine
Machine learning hardware
Machine learning tools
Machine learning frameworks
Proprietary machine learning frameworks
Open source machine learning frameworks
β’ Apache Singa
β’ Apache MXNet
β’ Caffe
β’ PyTorch
β’ mlpack
β’ TensorFlow
β’ Torch
β’ CNTK
β’ Accord.Net
β’ Jax
β’ MLJ.jl β A machine learning framework for Julia
Machine learning libraries
Machine learning algorithms
β’ ALOPEX
β’ Backpropagation
β’ CN2 algorithm
β’ Diffusion map
β’ FastICA
β’ GeneRec
β’ IDistance
β’ Leabra
β’ LogitBoost
β’ Out-of-bag error
β’ PVLV
β’ Q-learning
β’ Quickprop
β’ Rprop
β’ Skill chaining
β’ Sparse PCA
β’ Structured kNN
Machine learning methods
Instance-based algorithm
β’ K-nearest neighbors algorithm (KNN)
β’ Learning vector quantization (LVQ)
β’ Self-organizing map (SOM)
Regression analysis
β’ Ordinary least squares regression (OLSR)
β’ Multivariate adaptive regression splines (MARS)
β’ Regularization algorithm
β’ Ridge regression
β’ Least Absolute Shrinkage and Selection Operator (LASSO)
β’ Elastic net
β’ Least-angle regression (LARS)
β’ Classifiers
Dimensionality reduction
β’ Canonical correlation analysis (CCA)
β’ Factor analysis
β’ Independent component analysis (ICA)
β’ Linear discriminant analysis (LDA)
β’ Multidimensional scaling (MDS)
β’ Non-negative matrix factorization (NMF)
β’ Partial least squares regression (PLSR)
β’ Principal component analysis (PCA)
β’ Principal component regression (PCR)
β’ Sammon mapping
β’ t-distributed stochastic neighbor embedding (t-SNE)
Ensemble learning
β’ AdaBoost
β’ Boosting
β’ Bootstrap aggregating (also "bagging" or "bootstrapping")
β’ Gradient boosted decision tree (GBDT)
β’ Random Forest
Meta-learning
Reinforcement learning
β’ Q-learning
β’ Stateβactionβrewardβstateβaction (SARSA)
β’ Temporal difference learning (TD)
Supervised learning
β’ Averaged one-dependence estimators (AODE)
β’ Group method of data handling (GMDH)
β’ Lazy learning
β’ Minimum message length (decision trees, decision graphs, etc.)
β’ Probably approximately correct learning (PAC) learning
β’ Ripple down rules, a knowledge acquisition methodology
β’ Symbolic machine learning algorithms
β’ Random Forests
β’ Bootstrap aggregating (bagging)
β’ ANOVA
β’ Boosting
β’ SPRINT
β’ Naive Bayes
Bayesian
β’ Bayesian knowledge base
β’ Naive Bayes
β’ Averaged One-Dependence Estimators (AODE)
β’ Bayesian Belief Network (BBN)
β’ Bayesian Network (BN)
Decision tree algorithms
Decision tree algorithm
β’ Decision tree
β’ Classification and regression tree (CART)
β’ Iterative Dichotomiser 3 (ID3)
β’ C4.5 algorithm
β’ C5.0 algorithm
β’ Chi-squared Automatic Interaction Detection (CHAID)
β’ Decision stump
β’ Conditional decision tree
β’ ID3 algorithm
β’ Random forest
β’ SLIQ
Linear classifier
Unsupervised learning
Artificial neural networks
Association rule learning
Hierarchical clustering
Cluster analysis
Anomaly detection
Semi-supervised learning
Deep learning
β’ Deep Boltzmann machines
β’ Deep Convolutional neural networks
β’ Deep Recurrent neural networks
β’ Style transfer
β’ Transformer
Other machine learning methods and problems
β’ Classification
β’ Clustering
β’ Feature learning
β’ Learning to rank
β’ Occam learning
β’ PAC learning
β’ Regression
β’ Graphical models
β’ Bayesian network
β’ Conditional random field (CRF)
β’ Hidden Markov model (HMM)
β’ VC theory
Machine learning research
History of machine learning
Machine learning projects
Machine learning organizations
Machine learning conferences and workshops
β’ Artificial Intelligence and Security (AISec) (co-located workshop with CCS)
β’ ECML PKDD
β’ International Conference on Machine Learning (ICML)
β’ ML4ALL (Machine Learning For All)
Machine learning publications
Books on machine learning
β’ Mathematics for Machine Learning
β’ Hands-On Machine Learning Scikit-Learn, Keras, and TensorFlow
β’ The Hundred-Page Machine Learning Book
Machine learning journals
Persons influential in machine learning
β’ Alberto Broggi
β’ Andrei Knyazev
β’ Andrew McCallum
β’ Andrew Ng
β’ Anuraag Jain
β’ Armin B. Cremers
β’ Ayanna Howard
β’ Barney Pell
β’ Ben Goertzel
β’ Ben Taskar
β’ Brian D. Ripley
β’ Corinna Cortes
β’ Demis Hassabis
β’ Douglas Lenat
β’ Eric Xing
β’ Ernst Dickmanns
β’ Geoffrey Hinton
β’ Hartmut Neven
β’ Heikki Mannila
β’ Ian Goodfellow
β’ Jacek M. Zurada
β’ Jaime Carbonell
β’ Jeremy Slovak
β’ John D. Lafferty
β’ John Platt
β’ Karl Steinbuch
β’ Katia Sycara
β’ Leo Breiman
β’ Lise Getoor
β’ LΓ©on Bottou
β’ Marcus Hutter
β’ Mehryar Mohri
β’ Michael Collins
β’ Nando de Freitas
β’ Ofer Dekel
β’ Oren Etzioni
β’ Pedro Domingos
β’ Peter Flach
β’ Pierre Baldi
β’ Pushmeet Kohli
β’ Ray Kurzweil
β’ Rayid Ghani
β’ Ross Quinlan
β’ Sebastian Thrun
β’ Sepp Hochreiter
β’ Shane Legg
β’ Steve Omohundro
β’ Tom M. Mitchell
β’ Trevor Hastie
β’ Vasant Honavar
β’ Vladimir Vapnik
β’ Yann LeCun
β’ Yasuo Matsuyama
β’ Yoshua Bengio
See also
β’ Accuracy paradox
β’ ADALINE
β’ AIVA
β’ AIXI
β’ AlchemyAPI
β’ AlexNet
β’ AlphaGo
β’ AlphaGo Zero
β’ Concept learning
β’ Eager learning
β’ Feature
β’ GloVe
β’ Hyperparameter
β’ Learning rule
β’ Margin
β’ Markov chain Monte Carlo (MCMC)
β’ Markov model
β’ Offline learning
β’ Parity learning
β’ Tanagra
β’ Waffles
β’ Weka
β’ Loss function
β’ Mean squared error (MSE)
β’ Mean squared prediction error (MSPE)
Other
β’ Anne O'Tate
β’ Apache Flume
β’ Apache Giraph
β’ Apache Mahout
β’ Apache SINGA
β’ Apache Spark
β’ Apache SystemML
β’ Arthur Zimek
β’ Artificial ants
β’ Astrostatistics
β’ Ball tree
β’ Base rate
β’ Bat algorithm
β’ Bees algorithm
β’ Bernoulli scheme
β’ Biclustering
β’ BigML
β’ Bing Predicts
β’ Biplot
β’ Bondy's theorem
β’ Bongard problem
β’ BrownBoost
β’ Brown clustering
β’ Burst error
β’ CBCL (MIT)
β’ CMA-ES
β’ Category utility
β’ CellCognition
β’ Cleverbot
β’ CoBoosting
β’ Concept class
β’ Concept drift
β’ Confusion matrix
β’ Cortica
β’ Cuckoo search
β’ DADiSP
β’ Darkforest
β’ DarwinTunes
β’ Data exploration
β’ Dataiku
β’ Decision list
β’ DeepArt
β’ DeepDream
β’ Defining length
β’ Dendrogram
β’ Detailed balance
β’ Diffbot
β’ Distributed R
β’ Dlib
β’ Documenting Hate
β’ Dunn index
β’ EDLUT
β’ ELKI
β’ Elastic map
β’ Elastic matching
β’ Encog
β’ Entropy rate
β’ Erkki Oja
β’ Eurisko
β’ Evolution window
β’ Evolutionary art
β’ Evolved antenna
β’ F1 score
β’ FLAME clustering
β’ Factor graph
β’ Feature hashing
β’ Feature scaling
β’ Feature vector
β’ Fisher kernel
β’ Fitness function
β’ Fluentd
β’ Folding@home
β’ Frrole
β’ GATTO
β’ GLIMMER
β’ Gary Bryce Fogel
β’ Gaussian process
β’ Gene prediction
β’ Generative model
β’ Genetic operator
β’ Geworkbench
β’ Glottochronology
β’ Golem (ILP)
β’ Google matrix
β’ Gramian matrix
β’ GraphLab
β’ Graph kernel
β’ Growth function
β’ Harmony search
β’ Hebbian theory
β’ Highway network
β’ Hinge loss
β’ Huber loss
β’ IRCF360
β’ Ian Goodfellow
β’ Ilastik
β’ Ilya Sutskever
β’ Immunocomputing
β’ Inauthentic text
β’ Inductive bias
β’ Intel RealSense
β’ Island algorithm
β’ JOONE
β’ Jabberwacky
β’ Jaccard index
β’ Joseph Nechvatal
β’ Jubatus
β’ k-SVD
β’ k-means++
β’ k-medoids
β’ KNIME
β’ KXEN Inc.
β’ k q-flats
β’ Kaggle
β’ Kalman filter
β’ Kernel method
β’ Kinect
β’ Knowledge Vault
β’ LIBSVM
β’ LPBoost
β’ Labeled data
β’ LanguageWare
β’ Language model
β’ Latent variable
β’ Lattice Miner
β’ Lingyun Gu
β’ Linkurious
β’ Log-linear model
β’ MATLAB
β’ MXNet
β’ Mark V. Shaney
β’ Mean shift
β’ Medoid
β’ MeeMix
β’ Melomics
β’ MinHash
β’ Mixture model
β’ Mlpy
β’ Moral graph
β’ Movidius
β’ N-gram
β’ Neighbor joining
β’ Nest Labs
β’ NetMiner
β’ NetOwl
β’ Neural Designer
β’ NeuroSolutions
β’ Neuroevolution
β’ Neuroph
β’ Niki.ai
β’ Onnx
β’ OpenNLP
β’ Overfitting
β’ PROGOL
β’ PSIPRED
β’ PageRank
β’ Parity benchmark
β’ Path dependence
β’ Perplexity
β’ Pietro Perona
β’ Pipeline Pilot
β’ Plate notation
β’ Prisma (app)
β’ Probit model
β’ Q methodology
β’ Qloo
β’ Queueing theory
β’ Quick, Draw!
β’ Rada Mihalcea
β’ Rand index
β’ Random indexing
β’ Ranking SVM
β’ RapidMiner
β’ Rattle GUI
β’ Raymond Cattell
β’ Reasoning system
β’ Renjin
β’ Repertory grid
β’ Richard Zemel
β’ RoboEarth
β’ RuleML Symposium
β’ Rule induction
β’ SAS (software)
β’ SNNS
β’ SPSS Modeler
β’ SUBCLU
β’ Savi Technology
β’ Semantic folding
β’ Sense Networks
β’ Shattered set
β’ Shogun (toolbox)
β’ SimHash
β’ SimRank
β’ Sinkov statistic
β’ SolveIT Software
β’ Statistical parsing
β’ Stefano Soatto
β’ Stephen Wolfram
β’ String kernel
β’ TD-Gammon
β’ TIMIT
β’ Teuvo Kohonen
β’ Topic model
β’ Transiogram
β’ Trigram tagger
β’ UIMA
β’ UPGMA
β’ Uncertain data
β’ VC dimension
β’ VIGRA
β’ Validation set
β’ Varimax rotation
β’ Vowpal Wabbit
β’ WPGMA
β’ Ward's method
β’ Weasel program
β’ Witness set
β’ Wolfram Language
β’ Writer invariant
β’ Xgboost
β’ Yooreeka
Further reading
β’ Trevor Hastie, Robert Tibshirani and Jerome H. Friedman (2001). The Elements of Statistical Learning, Springer. ISBN 0-387-95284-5.
β’ Mehryar Mohri, Afshin Rostamizadeh, Ameet Talwalkar (2012). Foundations of Machine Learning, The MIT Press. ISBN 978-0-262-01825-8.
β’ Ian H. Witten and Eibe Frank (2011). Data Mining: Practical machine learning tools and techniques Morgan Kaufmann, 664pp., ISBN 978-0-12-374856-0.
β’ David J. C. MacKay. Information Theory, Inference, and Learning Algorithms Cambridge: Cambridge University Press, 2003. ISBN 0-521-64298-1
β’ Richard O. Duda, Peter E. Hart, David G. Stork (2001) Pattern classification (2nd edition), Wiley, New York, ISBN 0-471-05669-3.
β’ Christopher Bishop (1995). Neural Networks for Pattern Recognition, Oxford University Press. ISBN 0-19-853864-2.
β’ Vladimir Vapnik (1998). Statistical Learning Theory. Wiley-Interscience, ISBN 0-471-03003-1.
β’ Ray Solomonoff, An Inductive Inference Machine, IRE Convention Record, Section on Information Theory, Part 2, pp., 56β62, 1957.
β’ Ray Solomonoff, "An Inductive Inference Machine" A privately circulated report from the 1956 Dartmouth Summer Research Conference on AI.
References
cite-note-britannica-11. β http://www.britannica.com/EBchecked/topic/1116194/machine-learning This tertiary source reuses information from other sources but does not name them.
cite-note-33. β citerefron-kohavifoster-provost1998Ron Kohavi; Foster Provost (1998). "Glossary of terms". Machine Learning. 30: 271β274. doi:10.1023/A:1007411609915.
External links
β’ Data Science: Data to Insights from MIT (machine learning)
β’ Popular online course by Andrew Ng, at Coursera. It uses GNU Octave. The course is a free version of Stanford University's actual course taught by Ng, see.stanford.edu/Course/CS229 available for free].
β’ mloss is an academic database of open-source machine learning software.